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Abstract 

fvj \ We prove a heavy traffic Hniit theorem for a non-time homogeneous Markovian many server 

queue with customer abandonment. 

Oh ■ 1 Introduction 

"t^ I Many server queues with abandonment liave been extensively studied in the literature because 

of their applications to modeling call centers, see, e.g., Garnett, Mandelbauni, and Reiman [T], 

Whitt [71 [8], Zeltyn and Mandelbaum [9]. One can assume that the number of servers, K^ and 

the arrival rate. A, are large so the asymptotics as both K and A tend to infinity provide good 

approximations for the performance measures. Depending on the offered load X/{Kfj,), where ^ is 

the service rate at an individual server, there are three distinct regimes which loosely speaking are 

defined as follows: quality driven (QD) when the offered load is less than 1, efficiency driven (ED) 

'sj- ■ when the offered load is greater than 1, and quality-and-efficiency driven (QED) when the offered 

j->^ . load is approximately equal to 1. The heavy traffic limit theorems that substantiate the associated 

^D I approximations are usually proved separately for each regime, see Pang, Talreja, and Whitt [3] and 

references therein. In this paper we obtain a limit theorem for the number of customers which 

does not make any apriori assumptions about the offered load. The results for the different regimes 

follow as particular cases. Furthermore, the arrival, abandonment and service rates as well as the 

^ ' number of servers are assumed to be functions of time. This may account for the request rates, 

j^ ■ service rates and staff allocation depending on the time of day. In the case of constant arrival, 

abandonment, and service rates and a constant number of servers we derive the asymptotics of the 

steady-state distribution of the number of customers present. As it turns out, in the QED regime 

the stationary distribution is quite sensitive to the initial conditions. The proofs draw on Liptser 

and Shiryayev [2], Smorodinskii 0, and Puhalskii [HIS]. The paper is organized as follows. In 

Section [2] the main results are stated and proved. In Section [3l the stationary distributions are 

considered. 

2 A heavy traffic limit theorem 

We consider a sequence of Mt/Mt/Kt + Mt queues indexed by n G N. The nth queue is fed by a 
Poisson process of rate A" at time t. The customers are served by one of the K^ servers on a FCFS 
basis. If at a certain epoch, a server serving a customer becomes unavailable, so K^ decreases, then 
the customer being served is relegated to the queue. The service times are i.i.d. exponential of 
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rate fit- The customers may also abandon the queue after an exponentially distributed time with 
parameter Of. The functions A", fit, and 9t are assumed to be positive locally integrable functions, 
i.e., Jq X^ ds < oo, J^fisds < oo, and J^Ogds < oo . The functions K" are positive, Lebesgue 
measurable, and locally bounded, i.e., sup^gp,*] -^" < '^^ The number of customer present at time 
0, the arrival process, the service times, and the abandonment times are mutually independent. 

We denote A^ the number of exogenous arrivals by time t. It is a Poisson process of rate 
A^ by hypotheses. Customer abandonment will be modelled via independent Poisson processes 
i?"'*, i E N, of rate 6t and customer service times will be modelled via independent Poisson processes 
i?"'*, i G N, of rate fif Let Qq denote the initial number of customers. We assume that all these 
entities are defined on a complete probability space (Jl, .F, P) . All stochastic processes are assumed 
to have trajectories in the associated Skorohod space ©(R+jM) of rightcontinuous functions with 
lefthand limits. We model the evolution of the customer population by the following equation 
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l{Qj_AE'^"_>i} c?-B"''. (2.1) 

The third term on the right represents the number of customers who abandoned the queue by time 
t and the last term represents the number of service completions by time t . 
Denote 

t 

(2.2a) 

t 
dRf' - I OsiQ'^s - Ky ds, (2.2b) 



t 
dB^'' - I fisQ'lfy K ds- (2.2c) 



Let TJ^ denote the completion with respect to P of the a- algebra generated by Qq, A^, s < t„ 
Rf\ s < i, i G N, and Bf\ s < i, i G N. The associated filtration is denoted F" = iTJ', t G M+) . 
The processes M""^ = (M^"'^, t G M+), M""'^ = (M"-^, t G M+), and Af^'^ = (Mj^' , t G M+) are 
F"-locally square integrable martingales with respective predictable quadratic variation processes 

t 
(M"'^)t= f X'^ds, (2.3a) 



t 
{NP'\ = JOs (Q: - K)+ ds, (2.3b) 



t 
{M^'% = /" ^, Q- A K^ ds. (2.3c) 



In addition, since the processes A"- = {Af,t £R+), ii"'* = (i?"'*, t G M+), and -B"'* = {B^'\t G M+) 
have P-a.s. disjoint jumps, these locally square integrable martingales are pairwise orthogonal, i.e.. 



their mutual characteristics are equal to zero: 

(M"'^, M"'^)i = (M"'^, M"-^)i = (M"'^, M"'^)t = . (2.4) 

Theorem 2.1. Suppose that Q^/n converges in probability to a constant qq as n ^ oo, that 
Jq X^/nds — > Jq As ds /or all t, where (Xt) is a positive locally integrable function, and that K^ /n — > 
kt uniformly on bounded intervals oft, where {kt) is a positive locally bounded Lebesgue measurable 
function. Then, for all T > and e > 0, 

lim P( sup \^ -qt\ > e) = 0, 
"^°° te[o,T] n 

where (qt) is the solution of the integral equation 

t t t 



Proof. We first note that the integral equation for (qt) has a unique solution which follows by the 
fact that the infinitesimal drift coefficients are Lipshitz continuous. 
By dZlD, (IZ2a]), (f2:2bll . and dZ^c]), 
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91-K) + ds- [ f^s^/\^ds+-M^'^--M^'''--M^''' . (2.5) 
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We prove that 











lim P(i sup |M"'*| >6)=0 (2.6) 

for i = A,R, B, where T > and 6 > are otherwise arbitrary. The Lenglart-Rebolledo inequality, 
Liptser and Shiryayev [2], implies that it suffices to prove that 

lim P(^(M"'^)i>5) = 0. (2.7) 

71— »oo n 

The validity of (j2.7p for i = A and i = B follows by (j2.3ap and (j2.3cp . respectively, and the 
hypotheses that /q (A^ /n — A) ds — > and that limsup„_^ooSupsgro^j] -K'"/?^ < oo . In order to 
estabhsh (|2.7p for i = R, we note that by (|2.ip Q"/n < Qo/n + ^"/n. Since the latter quantity 
converges in probability to go + /q Xgds as n — > oo, it follows that limsup„_^oo P((5f/n > qo + 
/q As (is + 1) = 0, so (|2.7p for i = i? is a consequence of ()2.3bp . The limits in ()2.6p have been 
proved. 

By (j2.5p and the equation for (qt) in the statement of the theorem 
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By Gronwall's inequality, for T > 0, 
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sup \—^ - qt\ < (|— ^ - qo\ + sup | / {-^ - X) ds\ + sup / {fig + 9s)qs\—^ - ks\ ds 
tGfo.Tl n n iefo.Tl J n tefo.Tl J "^ 



tG[o,T] o- 't ie[o,r] J 'I- te[o,T] . 



H — sup \M^ ' I H — sup |Mj I H — sup |Mj he-'o 
" te[o,T] '^ te[o,T] ^ te[o,T] 



'^{9t+fit)dt 



By (j2.6p and the hypotheses, the righthand side tends in probabiUty to zero as n — > oo. (Note that 
the convergence J^ X^/nds -^ /q As ds is uniform on bounded intervals under the hypotheses.) D 

Corollary 2.1. Under the hypotheses of Theorem \2.1\ the processes M"' /-^/n, M^''' / y/n, and 
M""'-^ /y/n converge in distribution in B(R_|_,M) to the respective processes M = {Mf-, t G 1R+), 
M^ = (M/^, t G M+), andM^ = {M^ , t G M+), defined as follows: 

t 
M^ = j ^sdWf, 



t 
M^ = j ,/e,iq,-h)+dW^, 


t 
Mf = f ^/fisqsAksdW,^, 



where W^ = {W^, t £ M+), W^ = {W^^, t £ R+), and W^ = {W^^ , t £ M+) are independent 
standard Wiener processes. 

Proof. The processes M^' /^/n, M^-'^/y/n, and AI"^'^ /y/n are F"-locally square integrable mar- 
tingales. By (j2.3ap . ()2.3bp . (j2.3cp . and ()2.4p they are mutually orthogonal and their respective 
predictable quadratic variation processes are given by 

{^^)t= / —ds, 
\Jn J n 



t 

{^)t= e,{'^-f^)Us, 

yn J n n 



{^^)t = Uis^^^ds. 
y/n J n n 



By Theorem 12.11 the processes on the right converge in probability to the functions L A^ ds, 
/o (^s{qs — ks)^ ds, and Jq fig 9s A A;^ ds, respectively. (Actually the first convergence is deterministic.) 
We also have by ([X^ . (|2^ . and ([X^ that the jumps of the processes M"'^/^, W-^/^/n, 
and M"'^/-^/n are not greater than Xjyfn. The proof is finished by an application of Theorem 
7.1.4 in Liptser and Shiryayev [2]. D 



Introduce 

X? = V^{^ - qt) . (2.8) 

Theorem 2.2. Suppose that y/n J^i^X^ /n — A^) ds -^ L Os ds as n ^ oo uniformly on bounded 
intervals, where (At) is a positive locally integrable function and (at) is a locally integrable function, 
that ^/n(^K^^/n — kt) -^ "ft as n —> oo uniformly on bounded intervals, where {kt) is a positive 
locally bounded Lebesgue measurable function and {"ft) is a locally bounded Lebesgue measurable 
function, and that Xq tends in distribution to a random variable Xq as n ^ oo . Then the process 
X^ = {X"', t G M+) converges in distribution in D(R_|_,]R) to the process X = (Xj ,t G M+) that is 
the solution of the equation 



t t 

Xt = Xo+ I as ds 





asds- es{l{g^>ks} (Xs - Is) + ^g,=ks} (Xs - Is)^) ds 



t 

- lJ's{i{g,<ks}Xs+'i-{q,=ks}Xs/\"fs+'i-{q,>ks}ls) ds+ \/A^ + Osiqs - ks)+ + ^s 9s A kg dWs, 


where W = {Wt, t £ M+) is a standard Wiener process. 

Proof. The equation for X has a unique strong solution by the infinitesimal drift coefficients being 
Lipshitz continuous. Denote 7" = ^/n{K^^/n — kt) . By (j2.5p . (|2.8p . and the equation for (qt) in the 
statement of Theorem 12.11 we can write 

t t 

X^ = Xo" + y v^(^ - A,) ds- JOs^ {X^ + V^qs - (7? + V^ks))^ - V^iiqs - ks)+) ds 


t 

- [ fis({X^ + V^qs) A (7," + V^ks) -V^iqs A k^)) ds + ^ M,"'^ - ^ M,"'^ - ^ M,"'^ . 
J \ / yn -y/n -y/n 



(2.9) 

Hence, 

t t t 

\X^\ < l^ol + I / V^{^ - As) ds\ + f{ds + fis)\X2\ ds + [{ds + A^.)|7"| ds 
000 

/n \/n \/n 



Gronwall's inequality, the hypotheses of Theorem 12.21 and Corollary 12.11 imply that for T > 

lim limsupP( sup |Xj"| > r) = . (2.10) 

r^oo n^co t£[0,T] 

Also, for s < t, 

t t t 

\X^ - X^\ < \j ^{^ - K) du\ + [{Ou + /xJlX^^I du + j{d^ + ^^u)m du 

s s s 

' = I M"'^ - M?'^ I + ^ I M"'^ - M"'^ I + ^ I M"'^ - M"'^ I . 



Therefore, by (j2.10p . Corollary 12. H and the hypotheses, for all T > 0, ?] > 0, and (5 > 0, 

lim lim sup P( sup \X^ - X^l > rj) = ■ 

S~*0 n^oo s,t£[0,T]:\s-t\<5 

We conclude that the sequence X„ is C-tight, i.e., it is tight for convergence in distribution in 
D(M_i„,]R) and all its accumulation points are continuous-path processes. Let X be such a subse- 
quential limit. On noting that if a sequence of functions (x") converges for the Skorohod topology 
to a continuous function (xj), then J^ 6s{{x^ + \^qs — (7" + ^/nks)) — \/n{qs — ^s)"*") ds — > 
/o ^'^ ( l{g.>fcs} i^s - 7s) + l{g,=fc4 {xs - 7s)+) ds and J^ /i^ ( (x^ + V^Qs) A (7? + ^/nks) -^/^{qs^ 
ks)) ds -^ /p ^is{'^{q,<ks} ^s + l{g,=fc4 XsAjs+ l{g,>fc4 Is) ds, and on recalling Corollary [2Jl we 
conclude from p. 91) that X must satisfy the equation 



t t 



Xt = Xo + jasds- j Osi l{g,>fe4 {Xs - Is) + l{g,=fc4 (^s - 7s)+) ds 



t t 

- / /^s(l{'?.<fc4^«+l{9s=fc4^^'^7s+l{5,>fc4 7s)(is+ / ^/X^+lIiq7^^hWT7i^q7^^ dWs , 


where VF is a standard Wiener process. Since the latter equation has a unique strong solution, X 
coincides in law with X. D 

Remark 2.1. One can allow 6t and fit also depend on n. It is then necessary to require in Theorems 
12.11 and 12.21 that the (^f) and (^") converge to (Ot) and (fit), respectively, uniformly on bounded 
intervals. 

3 Stationary distributions 

In this section we assume constant arrival, service and abandonment rates, i.e.. A" = A", Af = A, 
9t = 6, fit = ft-, and at = a . The number of servers K^ is also assumed to be constant which we 
take as n, so fct = 1- Accordingly, 7t = 0. The equations for the fluid and diffusion approximation 
are as follows: 

t t 

qt = qo + Xt- e{qs - 1)+ ds - fiqsM ds, (3.1) 



t 

Xt = Xo + at- je{ l{g^>i} Xs + l{g^=i} X+) ds 


t t 

- J fi{ l|,^<i} Xs - l|,,=i} {-Xs)+) ds + I ^/X + e{qs-l)+ + fiqs/\ldWs, (3.2) 



We first investigate stationary solutions for {qt). 

Lemma 3.1. If X > fi, then limt^oo Qt = {X — fi)/0 + 1. If X < fi, then limt^oo qt = A//^. For all 
t, qt j^ I except when qo = 1 and X = fi in which case g* = 1 for all t . 



Proof. Suppose that X > /i . Then 

|('?*-^-1)' = 2(q,-^-1)(A-%,-1)+-/.,,A1). 

If qt-{X- fi)/9 - 1 > e for e > 0, then A - e{qt - 1)+ - fj.qt M < -Oe . If qt-{X- n)/e - 1 < -e 
for e G (0, (A - fJ,)/6), then A - 6{qt - l)"*" - fiqt /\l > Be . Hence, qt ^ {X - fi)/9 as t ^ oo . 

If A < /i, then a similar argument apphed to the function {qt — X/fi)'^ shows that qt -^ A//i . 
Suppose A = ^ . Then qt = A(l - qt)+ - e{qt - 1)+ . Hence, {d/dt){qt - if = 2{qt - 1)(A(1 - qt)+ - 
6{qt - 1)+) < -2(A A e){qt - if . Consequently, qt ^ 1 ■ 

D 

The existence of a unique stationary distribution for X" and convergence to it from any initial 
condition is standard. We now consider X. It follows by Lemma |3. II that if either A < // or A = /i 
and go < 1, then there exists to such that qt < 1 for all t > to so that 

t t 

Xt = Xto + a{t -to)-H Xsds+ ^X + fiqsdWs. 

to to 

Hence, 

t 

Xt = Xtoe-^(*-*o) + e-'^^*-*") f e'^^'-^'^^y^X+Jq'sdWs + -(1 - e-^^^*"*")) . 

J /^ 

to 

The second term on the right is a zero-mean Gaussian random variable with variance 
g-2/i(t-to) J"^ g2/i(s-to)^^ _l_ ^q^'j dg ^ Since qt — > A//i, we obtain that this variance converges to 
X/fi as t — > oo . We have thus proved that Xt converges in distribution in M as t — > oo to a 
Gaussian random variable with mean a/fi and variance A//i . 

If either A > /i or A = /u and qo > 1, then a similar argument shows that Xt converges in 
distribution as t — > oo to a Gaussian random variable with mean a/6 and variance X/6 . If A = // 

and qQ = 1, then 

t t 

Xt = Xo + at-e f X+ ds + ^L f{-X,)+ ds + v^Wi . 



This process is known to have the invariant density Cexp(jQ^(a — 0y'^ + /i {—y)~^) dy/fi) , where C 
is the normalization constant. 

We arrive at the following theorem. 

Theorem 3.1. Suppose that ■y/n(A"/n — A) — > a as n ^ cxo. If either X < fi or X = ^ and go < l? 
then the stationary distributions of the processes X"^ converge weakly to a Gaussian law with mean 
aj [I and variance Xj \Ji. If either X > fj, or X = fi and qo > 1, then the stationary distributions of 
the processes X" converge weakly to a Gaussian law with mean a/6 and variance X/6. If X = ^ 
and go = 1; then the stationary distributions of the processes X" converge weakly to a probability 
law with density Cexp((Q//i)x)(exp(— (0//i)x^/2) l{x>o} + exp(— 2:^/2) l{a;<o} ) • 

Proof. We only need to check tightness of the sequence of the stationary distributions of the X", 
see, e.g., Liptser and Shiryayev [2], Puhalskii [5] and references therein. Denote a" = ^/n{X^ /n—X) . 



Equation ()2.9p assumes the form 

t 
X^ = X^ + a''t-e /((X," + ^qs -V^^ - V^iQs - 1)+) ds 





t 



^, l({X^ + ^q,)A^)-^{q,Al))ds + ^M^'^-^M^'^-^M^'^. 



'n -y/n yn 



Consequently, for e > 0, 

t t 

{X]}f = {XSf + 2 f X2_ dX2 + J2 i^^s? = (X^f + 2«" f X2 ds 

o<^<* 

t t 

-29 I X," ((Xr + V^g, -V^Y- V^iqs - 1)+) ds-2fi f X," ((X," + ^/^q,) A V^- V^ (g, A 1)) ds 


t t t 

+ ^ I X^_ dM^^^ -^ I X^^ dM^'^ - 4= / K- dM^'^ + - Y i^M^'^f 

t 
+ - Yl i^^s'^f + - 12 i^K'^f < [Xof + 2a" f X^ ds 

0<s<t 0<s<t Q 

t t t t 

- 2(0 A m) j{x^f ds + ^l x:_ dM^'^ - -^ I x:_ du:'^ - A I x:_ du:^^ 



+ - y (AM^'^f + - y (am;'^)2 + - y (A^C'y 

0<s<i 0<s<i 0<s<t 

t t 

< (Xo")2 + la'^l 6 (|(X;)2 ds + |) - 2(0 A m) |(X:')2 ds 



t t i 

+ ^ [ X^_dM^'^-^ [ X2^dM^'^-^ f X2^dM^'^ 
y/n J ^Jn J y/n J 



+ - y {AM^f + - y {AM^'^f + - y {Au^'^f . 



0<s<t 0<s<t 0<s<t 



We pick e small enough so that 2 9 f\ jjl — \d^\e > 5 > for some 5 > and all n large enough. 
Then, for all n large enough, 



{X^f<{X^f + \a-\i-6J{X^fds 





t t t 

+ ^ /"x"_(iM"'^-4= /"x" dM"'-^-^ /"x"„dM"-^ 



n J y/n J \Jn 





+ - Yl i^M^'^f + - Yl i^M^'^f + - Yl i^M^'^f . (3.3) 

0<s<t 0<s<f 0<s<t 

Let, for c > 0, r^ = inf{t : \X^\ > c} . It is an F'^-stopping time. Since \X^_\ < c for t < r", 
the processes [L ^'^ X^-dMs'^, t G IR+), where i = A,R,B, are martingales for each n. Since 
the M"'* are purely discontinuous locally square integrable martingales, E^q^^<^^^„(AM"'')^ = 

On assuming that Qq = so that Xq = and taking expectations in (j3.3p with t A r " as t, 

t 

E(Xr^,„)2 < |a"| * + 1 (E(M-'^)i^.. + E(M-'«)m.," + E(M-'^)i^..) - 5 [ E{X2f !{,<..} ds . 
€ n J 



By dSjij), dljb]), and ([233), 

t 

- (E(M"'^)Mr« + E(M-'^)i^.n + E(M-'^)i^.n) < (^ + ;,)t + ^ r EX," !{,<,„! ^ ^ ^^ 
n " ' ^ n ' J ^ y/n 





Thus, for arbitrary 5' G (0, 5), for all n large enough, 

t t 

E{X^^^^f<\a^\- + {—+^i)t + ejq,ds + e,^t-5'JE{X^fl{,^,^^ds. 



Since r^ ^ oo as c ^ oo, by Fatou's lemma and monotone convergence, 

t t 

/ \n f If 

E(Xf )2 < |a"| t + [^+^)t + e qsds + 6-^ t - 5' E(X,")2 ds . 
en J ^\J'n J 



It follows that 



1 A" „ „!.!.. „5',, 



E(Xr)2<(|a"|-+ — +^ + sup g, + ^ ) (l-e 






A + /i + (9suptgK flt 



e n ,g 

so 

limsuplimsupE(X")^ < m + 

n— >oo t^oo Co 

The tightness of the stationary distributions of the processes X" follows. The theorem has been 
proved. D 
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